Parrondo's game using a discrete-time quantum walk 
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We present a new form of a Parrondo game using discrete-time quantum walk on a line. The two 
players A and B with different quantum coins operators, individually losing the game can develop 
a strategy to emerge as joint winners by using their coins alternatively, or in combination for each 
step of the quantum walk evolution. We also present a strategy for a player A (B) to have a winning 
probability more than player B (A). Significance of the game strategy in information theory and 
physical applications are also discussed. 
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I. INTRODUCTION 

Game theory gives an account of how the involved par- 
ties decide strategies in their personal interest in a given 
situation, on rational grounds. It has found to have rel- 
evance to social sciences, biology, and economics p]-0|, 
among others. By replacing classical probabilities with 
quantum amplitudes and allowing the players to employ 
superposition, entanglement and interference, quantum 
game theory has lead to new interesting effects and has 
become an active area of research. Quantum game can be 
quantified as, any quantum system which can be manip- 
ulated bytwo or more parties according to their personal 
interest ||, 0] ■ 

The system in which we propose a quantum game in 
this Letter is a quantized version of the classical ran- 
dom walk (CRW), that is, the quantum walk system. 
Quantum walk (QW) evolution on a particle involves 
the quantum features of interference and superposition, 
resulting in the quadratically faster spread in position 
space in comparison to its classical counterpart, CRW 
[8l-[l3|. QWs are studied in two forms: continuous- 
time bwfCTQW) [13 and discrete-time QW (DTQW) 
ITU . Ha . HU and are found to be very useful from the 
perspective of quantum algorithms |15l4l9j ; to demon- 
strate coherent quantum control over atoms; quantum 
phase transition [201 ] : to explain phenomena such as the 
breakdown of an electric-field driven system [2lT | and di- 
rect experimental evidence for wavelike energy transfer 
within photosynthetic systems [22|, HH ; to generate en- 
tanglement between spatially separated systems [Hj|; to 
induce dynamic localization in Bose-Einstein condensate 
in an optical lattice [25| . Experimental implement at ion 
of QWs has been made in an NMR system [2(a - [28| ; in the 
continuous tunneling of light fields through w aveg uide 
lattices [2{|; in the phase space of trapped ions (30l. l3l|: 
with single opticall y tr apped neutral atoms [32j ; and with 
single photons [33l. |34| . Various other schemes have been 
proposed for their realization in different physical sys- 
tems (35H37I. 
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In this Letter we present a quantum game, in the 
form of Parrondo's game, using a single-particle QW sys- 
tem. Parrondo's game involves two games, which when 
played individually, produce a losing expectation and 
when played in any alternating order, winning expecta- 
tion is produced [38|-|4(J. Parrondo's games were devised, 
originally, to provide a mechanism to harness Brown- 
ian motion and convert it to directed motion, or more 
generally, a Brownian motor, without the use of macro- 
scopic forces or gradients [4l| . They have since found 
applications in many areas. Their applications have also 
been made in the quantum regime. Grover's algorithm 
[42^ has been analyzed in the context of quantum Par- 
rondo's paradox |43| . A quantum implementation of a 
capital-dependent Parrondo's paradox, using an econom- 
ical number of qubits, has been presented in 44j. Differ- 
ent forms of Parrondo's game using a QW with a space 
and time-dependent potential (4f|, (with noise [H}), us- 
ing a QW with history dependence [47| . using a QW as 
a source of randomness for randomly switched strategies 
[48j and using cooperative QW in which interaction be- 
tween multiple participants replaces position-dependence 
as an opportunity for the Parrondo effect to occur (49} . 
have been introduced earlier. We present a simple form of 
Parrondo's game using two players A and B with differ- 
ent quantum coins as quantum coin operators to evolve 
single-particle DTQW on a line. If the player A (B), 
using his coin evolves the DTQW to t steps such that 
the probability on the right (left) hand side of the ori- 
gin (x = 0) of the particle subjected to QW is greater 
than that on the left (right), the player A (B) is declared 
as winner. In the game form we present, the players A 
and B individually losing the game using their coins can 
develop a strategy to maintain equilibrium (equal prob- 
ability on both the sides of the origin) and emerge as 
joint winners using their coins alternatively, or in com- 
bination for each step of the DTQW evolution. We also 
present a situation where player A (B) can have a win- 
ning probability more than a player B (A) and emerge as 
a solo winner. Recently, using the chirality distribution 
of the DTQW, a coin flipping game has been presented 
[50j . We believe that the manipulation of DTQW in the 
form of game using multiple players will give a general 
framework for application of QW, using multiple coins, 
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to algorithms and various physical processes. 

In Sections lU and Hill we present the standard form of 
DTQW and Parrondo's game. In Section [IV] a game us- 
ing DTQW, in the form of Parrondo's game, is presented. 
Different strategies for different situations is discussed in 
Section [V] In Section [VTl we conclude by discussing the 
significance of game strategy in information theory and 
physical applications. 



II. DISCRETE-TIME QUANTUM WALK 

The DTQW in one-dimension is modelled as a 2 x K 
system, that is, a two-level system (a qubit) in the Hilbcrt 
space T-L c , spanned by |0) and |1), and a K level position 
system, a position degree of freedom in the Hilbert space 
Hp, spanned by \ip x }, where x € I, the set of integers. 
A t-step DTQW, with unit time required for each step 
of walk, is generated by iteratively applying a unitary 



operation W which acts on the Hilbert space H. c ® Wr 



I** 



(i) 



Here |* ins ) = (cos(<f/2)|0> + sin(J/2)e^|l)) <g> is an 
arbitrary initial state of the particle at the initial position 
x = and W = S(B ® 1), where 



cos(0) 
sin(0) 



sin(0) 
cos(0) 



G U(2), 



(2) 

is the quantum coin operation which will evolve the par- 
ticle into the superposition of the particle state. S is a 
controlled-shift operation 



[|0)(0| <g> IV* - l)(ip x \ + |1)(1| ® + l>(^x| 



(3) 

and shifts the particle in superposition to superposition of 
position space. The probability to find the particle at site 
x after t steps is given by P(x, t) = (i/) x \tr c (\ i I?t){ i &t\)\il>x)- 
For a particle, with initial state at the origin 

|* in8 ) = -^(|0)+i|l))®|Vo), (4) 

using an unbiased coin operation, that is, B^ t g^ with 
£ = C = (-Bo. e.o = Be), the variance after t steps of walk 
is [I — sin(0)]i 2 and a symmetric probability distribution 
in position space is obtained. Choosing = 45° {B^/a) 
leads to a standard form of DTQW, the Hadamard walk 
[5l| . For = 0, the two states, |0) and |1) move away 
from each other ballistically without any interference ef- 
fect. With increase in 0, interference effect is seen and the 
distribution which is wider for low values of 0, becomes 
narrower with increase in 0. The interference effect again 
disappears for the other extreme value of = tt/2. The 
two horned peaks on either side of the distribution, which 
move away with increase in the number of steps, makes 
QW highly transient in nature. Small amount of deco- 
herence in QW dynamics enlarges the range of quantum 



dynamics by providing a wider range of possibilities for 
tuning the properties of Q Ws J52{ and to observe sym- 
metries Aperiodic QW [54j and disordered QW Hf| 
also enlarge the range of QW dynamics. 



III. PARRONDO'S GAME 

Standard form of Parrondo's game involves games of 
chance. Two games, A and B, when played individually, 
produce a losing expectation. An apparently paradox- 
ical situation arises when the two games are played in 
an alternating order, a winning expectation is produced 
[38H40l [4f| . The apparent paradox that two losing games 
A and B can produce a winning outcome when played 
in an alternating sequence was devised by Parrondo as 
a pedagogical illustration of the Brownian ratchet [55| . 
However, Parrondo's games have important applications 
in many physical and biological systems, combining pro- 
cesses lead to counterintuitive dynamics. For example, in 
control theory, the combination of two unstable systems 
can cause them to become stable [56|. In the theory of 
granular flow, drift can occur in a counterintuitive direc- 
tion (57l - [59| . Also, the switching between two transient 
diffusion processes in random media can form a positive 
recurrent process (60j . 

A brief analysis of Parrondo's paradox can be done 
by considering two games, A and B. Game A can be 
thought of as a simple coin tossing one, such that a win 
(say heads of the coin) occurs with a probability P and 
a loss (say tails of the coin) occurs with a probability 
(1 — P). The scenario where A is loosing could be thought 
of as a game involving weighted coins. Game B is more 
involved in that it is a capital dependent game, with the 
game strategy dependent upon the initial capital avail- 
able with the player. It is possible to devise situations 
wherein both the games are individually loosing, but a 
randomized combination of the two results in a winning 
game. This was shown in [39| using Markov chain theory. 



IV. PARRONDO'S GAME USING DTQW 

Here we present a novel scheme of a game in the set- 
ting of a DTQW, viz., one in which two players A and 
B use different quantum coin operators to walk on a sin- 
gle particle. Multiple coin DTQWs have been studied 
before |61[ and the effect of various coin parameters has 
been studied by [62j]. Both these features have been ex- 
amined together in the form of Parrondo's game for the 
first time here, to the best of our knowledge. This could 
have impact on the studies of directed phenomena such 
as ratchets on DTQWs. 

To construct a Parando's game like situation using 
DTQW on a line, we will consider two players A and 
B, as shown pictorially in Fig. ((T|), and construct the 
game as follows, 
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• Both the players A and B are given different quan- 
tum coin operations B^ g and B^ g * with two non- 
zero variable parameters each and a common shift 
operator S to evolve DTQW. 

• Initial state of the particle at the origin, x = 
on which they have to evolve the walk should be, 



1 



(|0>+i|l»®hto> 



• Player A is considered a winner if the probability of 
finding the particle to the right of the origin, Pr, 
is greater than the probability to the left of the ori- 
gin, Pl, that is, Pr > Pl after t number of steps 
of DTQW evolution. Similarly, player B is consid- 
ered a winner if Pl > Pr after t number of steps 
of DTQW evolution. If both the players A and B 
together manage to maintain equal probability on 
both the sides, Pl = Pr, they are declared as joint 
winners. 

Pl= Pr 
Winner : Both 



Pl >Pr 
Winner : Player B 



p > p 



Winner : Player A 





Position 

FIG. 1: Pictorial illustration of the conditions for the player 
to be declared winner. 



From Sec. HJ we know that W^e,c, = S{B^_e.Q ® 1) on 
| 'fins) implements one step of DTQW. This will evolve 
the particle to, 

Wt,e, ( \V ins ) = i( e?;? C0S W + %eK sin W) 1°) ® 1^-0 

+ (+e-< sin(0) - ie~^ cos(0)) |1) ® |^+i>].(5) 

The position probability distribution from Eq. ([5]), after 
the first step, corresponding to the left and right positions 
are h[l ± sin(20) sin(£ — Q]. These probability distribu- 
tions would be equal and lead to a left-right symmetry 
in position, if and only if £ = £. That is, the parameters 
£ 7^ C introduce asymmetry in the position space proba- 
bility distribution from the first step itself. The effect of 
different values of coin parameters after 100 steps of walk 
is shown in Fig. [5] plotted using numerically obtained 
values. We thus find that the generalized operator 
as a quantum coin can bias the probability distribution 
of the quantum walk in spite of the symmetry of initial 
state of the particle. This is the key point in developing 
a winning strategy for Parrondo's game using DTQW. 
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FIG. 2: Spread of probability distribution after implementing 
100 steps of DTQW using different values for the coin pa- 
rameters of player A, Bf B0 [(a) and (c)] and player B, Bq 9 ^ 
[(b) and (d)]. Parameter £ in B^ g o shifts the distribution to 
the left: (a) = (f,f,0) and (c) = (ff,f,0), Pl > Pr. Pa- 
rameter £ in Bf? g shifts the distribution to the right: (b) = 
(0, f , f ) and (d) = (0, f , -If), P R > P L . The initial state of 
the particle used for the walk is |^i ns ) = ® IV'o)- 



From the preceding analysis, Eq. ([5]) and Fig. [5] wc 
know that DTQW with -Bo.e.o on a particle in state |\&i ns ) 
results in a symmetric distribution. For < £ < 7r/2 
when C = using player A's coin B^ g , the distribution 
results in asymmetry with Pl > Pr. Therefore, player 
A can never win a game with the given quantum coin. 
Similarly, for < ( < tt/2 when £ = using player 
B's coin Bqq £, the distribution results in asymmetry 
with Pr > Pl- With increase in £ and £, the difference 
between Pr and Pl also increases. 

Therefore, both players A and B can never win a game 
independently with the given quantum coins B^ g and 



o,e,c 

We should note that even though coin B^ g or B^ g , 
contribute for asymmetry, the variance of the walk does 
not deviate much from the variance of the symmetric 
distribution (5lJ . This is because the variance of the walk 
largely depend on the value of 9 and the value of 9 is same 
for both the players. This is a genuine game and results 
from this are not any convention dependent. 



V. WINNING STRATEGY 

Here we discuss our simple scheme of the winning 
strategies of the game on a DTQW. The winning strate- 
gies are developed making use of the different coin op- 
erators. The parameter £, 9 and £ are physically real- 
izable rotations on the two state system [5l| and hence 
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FIG. 3: Spread of probability distribution after implementing 
100 steps of DTQW using different values for the parameter 
using operation W^^, that is, player A and B using both 
of their coins for each step of the walk. If player A chooses 
£ < 7r/2, player B can emerge as solo winner if he chooses 
£ > £. If player B chooses £ < £, player A will emerge as 
solo winner. However, joint winning can be ensured if player 
A chooses £ = n/2 irrespective of any parameter player B 
chooses for his coin operation. The initial state of the particle 
used for the walk is |* ins ) = -4(|0) + i|l>) ® |V>o>- 



restrictions on the rotational degree of freedom lead to 
situations presented here. We believe this to be a new 
and simple way of implementing a game on a DTQW. 

For the game presented in Sec. IIV1 players emerging 
as joint winners, that is, with Pi = Pr will be a ideal 
situation. To emerge as joint winners, the players have 
to first coordinate between them. They can coordinate 
at two levels, first level coordination is by alternatively 
using their coins for each step of the walk, if they are sure 
that the winner is decided after even number of steps of 
walk evolution or by using both of their coins, one after 
the other for every step of the walk. Second level of coor- 
dination is to consult each other in choosing the quantum 
coin parameters £ and £ {9 is common for both). First 
level of coordination is a necessary condition for the play- 
ers to emerge as winners and hence they are always given 
that choice. Players are not always allowed to coordinate 
at the second level but they can still emerge as winners. 

First we will discuss the strategy when both the players 
agree to cooperate at both the levels, followed by the 
strategy when they have allowed only for first level of 
coordination. 



A. Players A and B are allowed to consult each 
other and the winner is decided after even number 
of steps of walk evolution 

A simple strategy for players A and B will be to coop- 
erate between themselves for choosing the coin parameter 



and emerge as joint winners. This can be achieved if both 
the players agree, 

1. To use same value for £ and £ in their respective 
coins; 

2. Use their coins for every alternative step such that 
their coins are equally used. 

The evolution can be written as, 

W B e,C w ie,o K,e,( W ie, 1 . (6) 

or 

n^A n,,Vjr/;;, :: >i'- • ( 7 ) 

where W£ 0fi = S(Bg e o ® 1) and W^ e c = S(B^ e ( ® 1). 
If the number of steps is odd, the player who uses his coin 
operation one time more than the other will narrowly lose 
the game. We will discuss the strategy for a walk with 
odd number of steps later. 

B. Players A and B are not allowed to consult each 
other and the winner is decided after even number 

of steps of walk evolution 

When both the players are not allowed to consult each 
other to choose the coin parameters £ and £, a loosing 
situation may arise for both the players. To illustrate 
this further, if player A chooses some value for parame- 
ter £, the winner of the game depends on the choice of 
parameter £ by player B. If player B chooses parameter 
£ < £, player B will emerge as a winner over the player 
A and if player B chooses £ > £, player A will emerge as 
a winner over the player B. However, a player can make 
a careful choice of his coin parameter and make sure that 
he either wins the game alone or emerge as joint winner 
if the other player is also equally careful. This can be 
achieved by choosing the lowest non-zero values (initial 
rule of the game) for the coin parameters £ and £ of the 
respective players. For example, player A choosing £ = e, 
e being the smallest possible value greater than zero al- 
lowed in the coin operation, will make sure that player 
A wins if player B choose £ > e or will emerge as joint 
winner if player B also choose £ = e. 

C. When the winner is decided after t (even or odd 

number) steps of walk 

From the preceding two strategies we know that if the 
winner is decided after even number of steps of QW, both 
the players can emerge as joint winners. If the winner is 
decided after odd number of steps, the player who started 
the game by using his coin first will narrowly lose the 
game. Knowing this, if the players are not told of when 
the winner will be decided, none of them will agree to 
start the game. In this case they can agree upon a new 
strategy of using both of their coins for each step of the 
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walk such that both of them would have used their coins 
equally when the winner is decided. 



where 
and 

W$f f = S{B( Aa ®1)(B* 9>C ®1) 



Action of W BA on |^i n s) results in symmetric distribu- 
tion only for some specific values of £ and £ together. 
If player A chooses some < £ < n/2, player A (B) 
can emerge as a solo winner if player B chooses C < £ 
(C > £)• Following Eqs. (fTUf and (fTTj) . one can guar- 
antee that the player who starts the game can choose a 
parameter of the coin such that he always wins, either 
as solo winner or joint winner. For player A starting the 
game, picking £ = 7r/2 will ensure a joint winning situa- 
tion even if player B tries to fix £ 7^ £ ( 6 = tt/4 is kept 
the same for both the players). For player B starting 
the game, picking £ = tt/2 will ensure a joint winning 
situation even if player A tries tofix0<£<7r/2 (note 
that £ 7^ 7r/2, as it will lead to an initial state without 
shifting to either left or right). In Fig. [3l we have show 
the winning strategy for walk using WPg*, Eq. (fTU|) . 



VI. CONCLUSION 

Superior performance of quantum strategies is usu- 
ally seen, if entanglement is present. In the context of 
DTQW, this is natural as the walk evolves by entan- 
gling the coin and position degrees of freedom. There- 
fore, making use of the above, and the fact that the walk 
can be manipulated by varying the parameters in the 
quantum coin operation, we presented a scheme for a 
quantum game using DTQW in the form of Parrondo's 
game. Our system involves two players A and B as quan- 
tum coin operators to evolve DTQW on a line. We pre- 
sented a situation where both the players are unable to 
manipulate a walk to an extent to win a game using their 
coins individually. We presented a quantum strategy for 
the players to cooperate by using their quantum coin 
operations alternatively and emerge as joint winner for 
situations where it is conditioned that the winner is de- 



The evolution can be written as, 

(8) 
(9) 

(10) 



(11) 
I 

cided only after even number of steps of walk evolution. 
A different joint winning strategy, by using their coins 
in combination for each step, is presented for situations 
where the time (after even or odd number of steps) when 
the winner will be decided is not known. When both 
the players are equally careful in choosing their param- 
eters, they can always emerge as joint winners and only 
a less careful player will be prone to lose the game. Our 
scheme has fixed a specific initial state for the particle 
on which the walk is evolved and different coins are al- 
lotted to players A and B accordingly. One can choose 
any initial state for the particle, for example, |0) or |1) 
or any of its linear combination and different coins and 
strategies for player A and B can be worked out. Param- 
eters £, 6 and £ are physically realizable rotations on the 
two state quantum system [5lL [53j and hence restrictions 
on the rotational degrees of freedom lead to situations 
presented in this Letter. These strategies, leading the 
players to emerge as joint or solo winners can be very 
useful for various physical situations. For example, to 
arrive at equilibrium (equal on both side of origin), or 
any non-equilibrium (towards one side) configuration in 
the probability distribution as required during its appli- 
cation for algorithms or other physical process such as 
ratchets. 

The causal structure of QW evolution, as shown re- 
cently jj63|, puts in perspective the nature of quantum 
information processing involved in a quantum Parrondo's 
game using QW, in that it provides an upper bound on 
the propagation of quantum effects of interference and 
superposition. The effect of a noisy input to a quantum 
game has been studied and it is known that a suitable 
level of noise can enhance the payoff to the players. In 
this context, it was noted [64| in a study of the effect 
of decoherence (a form of noise due to interaction of the 
system with its environment) on a quantum game anal- 
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ogous to a three-player duel, that the boundary in the 
parameter space, in a transition from the quantum to 
classical (by increasing the influence of noise), changes 
from convex in the quantum case to linear in the classi- 
cal one. This is of interest since convexity is thought to 
be the basis for Parrondo's paradox. 

As discussed in the introduction, Parrondo's games 



were devised, originally, to provide a mechanism to har- 
ness Brownian motion and convert it to directed motion. 
In conclusion, causal structure of QW evolution, effect 
of decoherence on Parrondo's game using QW evolution 
can provide a mechanism to harness QW evolution for 
various quantum information processing tasks and other 
applications. 
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